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s \ { > I i ^ I \ stings I 

application: 

1 . {"Currently Amended ; A method of generating a natural language understanding (NLU) 
!v\e <. v ^ ^ \v v \ t ' 1 ^ 

X i 0 w <_ ' 5 «. \ dui '}N 

<s , vT <m '0 .- mccs. 

(c) building a second NLU mode! using the sample utterances as new training data 
and using the at least one hand crafted rule; 

(d) testing the performance of the second NLU model using a first batch of labeled 

data: 

i.e) building a series of N LU models by adding a previous batch of labeled data to 
< . ij eel v \ mm v e \o\ bvch of labeling data as test data to generate the series of NLU 
t crease t ns it 

, n „ t-.. em • x. , v m . - kvj ^ * . u smr * »"» -df - * m <m da< • ^ 

t s . s , cum ■ meeNmiUi u: N node] 

_ , t ^ v ? l ' k 1 o \ f t J v < _ _ ~ ^ ^ T a , 01 

service. 
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2. ren 5 d) M, method oi claim I , ftirtl e con pi - s - 

, J , C t + ' .o- . \ t O v - N 

^ 5 M» t U v*"4 ^ t > 1 ^ s - n ! 

model 

3. (Original ) The method of claim 1, further comprising: 

i P ■ po= Ormmg nil ^'0 v ■> \h>1 . u m on k l v N > ) \ u 

! _ <. v i * ) v ' 11V d ' 1 n it ! >itO N 1 Kk!u 0 

(j) augmenting the fourth NLU mode! using utterances obtained fmm a customer 
. _ . 

4. (No! Entered) 

5. (Currently Amended) The method of claim i[4j] 3, further comprising ignoring the 
t.erances mtare e; hm a spec c hreshoici 

6. ofanenh; vm.rn.kOi I bo method ot o.aitn 5- whercm the trc ~^vT ,>mv \ -.m.o 

7. ( ^ ei > < hi d of ciain v ere i \e sa e a - s i *uman 

os ' v j v ! o i i .... mon mm 

threshold amount. 

8. (Original) The method of claim 7. wherein the threshold is SO words. 

9. : i > i_ * > } h..- merb »J i claim I . wherein son>e examples in the r guj«k» are ignored 



, > : ; ^s 



1 0, (Currently Amended} The method of claim 1 , wherein the step of building a series of 
NLU noaJ- by _ a „ > j batch x >_ i a; mahfmg ama <. naaig 3 ;x\\ hi d 1 m 
labeling data as test data to generate the series of NLU models with training datafj . j j . 

11. C are \i d) A method of generating ;n c 
nuxlel for twe m a >pmwr. dmh-g <■ ]./c. the method comprising: 

>e> bed a v - l -' v - v 1 >^\1cf i - n; 1 ! > s ' ° ' g«***e, 

hand aa>fk < t teranco liiuhle 1 1 ' * , n i a ft f 

dialogs, if available; 

? c\ v", areeo fne fma NH nutk t s aj s 1 e s sees n the 

labeling guide; and 

(e) bedding a series of NLU models and evaluating the performance of the series of 
'<{ I mode s e>s nan-a d.iia ae.or es available by: 

(i) adding a previous batch of labeled data in training data: egad 
(il) using a new batch of labeling data as test data to generate the series of 
. » < s a t. i v, eonstamh 

12. u - ^ iv. «. i e s ^ ! - <■ * 

. t c \pi <. v U ' . } idin the mixed d i id test -lata. 

13, <} nal c hod of claim 1 1 whe l n i ie s ep oi bui f m i series > V 1 moc e - 

- v ex %ax *e\t ->v f ar e ,mk > U 
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14, ('Origin \\ ? I he method of claim i I . wherein the step of building a series of XI I ) models 

11 i 1 Ui n ai ; exu 

15. ^"j. v. < J > ^! » m k k ■> 1 t - v. 

ct com e < o 

dialog system, the NLU modes generated according to a process comprising: 
3 st NLU model ining sample ) 
. ^ :t e ,u\esoi a\ liable *u< > \ n i m rriJ''k 

(b) testing the performance of the first NLU model using sample utterances/in the 
labeling guide; and 

j 5 M,t es v be ^er ti> i«f 

M v ro "c ^ v. - 1 

vV <m k - \!oih'\k i>m . cJ d,m to ua: Jo.; ane 

> ic ! _ a ^ je fe , ,v jk -o i -> 

\ c oust mi > 

17. Origin ' lM mode ofc i t v\ erei l . <II node! s jenerate 3 a method 
further compmhm: 

\ o - \ . N ><v hi -at <. I"" 1 . 

acceptance test. 
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18. N > _j t t \ > >f claim 17, wherein the Mil model 5s enenUed ; nethod 

a i-ompH- i^nir!:^ ihv - ih;H arc mi.,' n specify ihroshi Jd. 
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